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A  DYNAMIC  PROGRAMMING  APPROACH  TO  A  COST-EFFECTIVENESS  PROBLEM 

ABSTRACT 

The  selection  of  an  optimal  weapon  system  on  a  cost-effectiveness  basis  is 
formulated  as  a  mathematical  programming  problem.  The  problem  is  solved  using 
the  functional  equation  technique  of  dynamic  programming. 

The  determination  of  certain  "appropriate”  values  for  the  arguments  of  the 
functional  equations  is  illustrated  by  a  numerical  example.  The  arguments  are 
obtained  in  a  systematic  manner  by  resorting  to  the  construction  of  auxiliary, 
bookkeeping  tables. 
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INTRODUCTION 


In  evaluut ing  the  relative  value  of  a  invert  weapon  system  with  respO'-b 
to  all  other  weapon  systems,  frequently  a  cost-effect J vonoss  busis  is 
established. 

A  criterion  for  Judging  the  effectiveness  of  weapons  systems  involves 
a  comparison  of  the  results  achieved  by  the  respective  weapon  systems  with  the 
costs  of  the  systems. 

Cost  may  be  regarded  not  only  as  monetary  cost  but  as  the  cost  of  the  effort 
required  to  prodb.ee  and  use  the  weapon.  The  evaluation  of  weapons  based  on  such 
a  comparison  of  results  with  efforts  may  be  done  in  either  of  two  ways:  (l)  in 
the  first  procedure  one  fixes  the  cost  of  the  effort,  and  endeavors  to  choose-  a 
weapon  system  or  a  set  of  weapon  systems  which  yield  a  maximum  of  results; 

(2)  in  the  second  procedure,  one  fixes  the  results, e.g.,  an  expectation  of 
destroying  several  targets,  and  endeavors  to  choose  a  weapon  system  or  systems 
which  achieve  this  result  wi-,h  a  minimum  cost.  Briefly,  form  (l)  gives  maximum 
results  for  fixed  cost,  and  form  (2)  provides  for  determining  the  nininom  cost 
required  to  obtain  fixed  results .  The  first  procedure  was  employed  for  the 
current  study. 


STATEMENT  OF  THE  PROBLEM 


Suppose  that  we  are  to  select  a  weapons  system  composed  of  n  elements 


^l*  Eg, 


,  Er.  The  cost  of  the  system  is  not  to  exceed  the  amount  C.  This 


system  is  to  be  used  to  perform  an  assignment  with  a  result  measured,  by  the 
function  R(E^,  Eg,  ...  ,  E^j .  There  exist  several  alternative  choices  for  each 
element  Ej^  of  the  system,  i.e.,  Ei  belongs  to  the  set  {E^,  ^±2*  ***  ®Ui(iP  * 


Associated  with  each  E^j  is  a  corresponding  cost  c^j. 


1  il'  12'  **•  -iii(i)' 
The  problem  then  is 


( 


<  i  Eq.  f  •••  t  <  ) 


subject  to  the  constraint 


+  C2 1. 


+  •  *  •  +  c 


Fortunately,  for  the  particular  problem  binder  consideration  the  measure  R  has  a 
separability  property, i.e.,  R(EX,  Eg,  ...  ,  En)  =  g-j^)  *  g2(Eg)  ...  •  g^(E  ). 
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We  :uv  then  able  to  reformulate:  the  problem  a:;  a  mu.lt  I  stage  decisior'  problem 
apply  thr  functional  equation  technique  of  dynamo  programming  to  obtain  a 
feasible  computational  scheme.  The  non L  is  to  reduce  the  n -dime ns i ona L  probl/m 
to  a  sequence  of  one -dimensional  problems.  The  ith  stage  °f  the  problem  will 
result  in  a  determination  of  an  E^ .  To  attain  this  simplification  wc  Imbed  the 
problem  within  a  family  of  similar  problems,  that  is,  instead  of  considering 
a  particular  total  cost  of  the  weapon  system,  and  a  fixed  number  of  element;;  o, 
the  system,  we  consider  an  entire  family  of  problems  where  the  cost  may  ar..,amc 
any  value  less  than  C  and  the  number  of  elements  may  be  any  natural  number  .le. ... 
than  n.  This  approach  enables  one  to  obtain  vital  Information  about  the  charge 
in  optimal  policies  as  the  basic  parameters  C  and  n  vary.  Surprisingly  it  is 
easier  (computationally)  to  treat  the  original  problem  by  consideration  of  the 
family  of  problems. 

DYNAMIC  PROGRAMMING  FORMULATION  OF  THE  PROBLEM 

To  treat  this  maximization  problem  by  means  of  functional  equation 
techniques,  we  introduce  the  function  f^Cc)  defined  for  0  -  c  £  C  and 
k  =  1,  2,  ...  ,  n  by  the  relation 

fkb>  ’  f,  «“  .  ,  [8i(EU>  '  •  -  *  gK(Ekj  i 

where  tbs  maximum  is  to  be  taken  over  all  vectors  (j^,  •••  >  such  that 


Clj1  +  C2j2  +  **•  +  CkJk  *  C* 


Then  f,  (e)  represents  the  maximum  value  of  R  associated  with  a  weapon  system 

Iv 

involving  k  elements  with  a  total  cost  of  not  more  than  c  units.  The 
maximization  involved  in  the  above  equation  can  be  accomplished  in  k  one¬ 
dimensional  maximization  processes  by  employing  Bellman’s  Principle  of  Optimal! t 

Then, 

fk(c)  =  Max  [g^j  )  fk_!  *  =  2-  —  -  »• 

Jk  k  K 

When  k  =  1, 
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where 


r  (e)  -  Max  (e ,  ), 
J1 


<• . 


A  SPECIAL  PROBLEM 

A  weapon  system  is  to  be  composed  of  three  units,  a  gun  unit,  a  projectile 

unit,  and  a  fire  control  unit.  The  weanon  system  is  to  be  assigned  the  task  of 

destroying  a  particular  target.  The  measure  R  is  to  be  identified  with  the 

probability,  Q,  that  the  system  will  destroy  the  target.  Therefore  we  have  at 

our  disposal  a  set  of  guns  (G^,  G^,  ...  ,  G^} ,  a  set  of  projectiles 

{P^,  Pn,  ...  ,  P^} ,  and  a  set  of  fire  control  units  {F^,  F^,  ...  ,  F^} .  Let 

c_  ,  c_  ,  and  c_  designate  the  "costs"  associated  with  the  gun  G  ,  the 
°i  PJ  Fk  1 

projectile  P.,  and  the  fire  control  unit  ?  respectively.  The  problem  is  to 
J  1 


Max 


«<pi’  °y  V 


subject  to  the  constraint 


CF  +  CG  +  CF  *  C' 
i  J  k 


where 


A  N 

v 


Q(pi’  Gy  V  =  n2  » 


A  =  A  (P, )  is  vulnerable  area, 

v  V  1 


and 


N  =  Kt^Gj)  is  the  number  of  rounds  fired, 


S  =  S(F^)  is  the  average  of  the  lateral  and 


vertical  standard  deviations  of  the  miss  distance  (ft). 
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■* w.jUfliyv  * 


\ 


Let 


and  let 


where 


‘■l  *  Av  ' 


Co  =  N  , 

i, 

1 

Cz  =  2  ’ 

3 


f  (c)  «  Max  g,(P. )  Co(C ,)  g,(F,.) 
[P^Oj,^)  11  •  J  5  k 


cp  +  Cr  +  Cp  £  o. 

P1  °J  Fk 


Using  the  results  of  the  previous  section  we  find  that 


fjc)  =  Max  g, (P.)  , 

1  {pj  1  1 


(i) 


'pi  ’ 


f2(c)  =  Max  fg  (G  )  f,(c-c  )n  , 

2  {Oj}  L  2  3  1  J  J 


(P) 


ar.d 


CG.  5  c  ’ 


f,(c)  3  Max  fg,(F  )  f_(c-c  )1 

3  (FkJ  L  3  k  2  fk  j 


(3) 


C_  S  c  . 
Fk 


10 


AN  I LLUCTRAT  TVcl  EXAMPLE 


Problem:  Given  a  l. ot.nl  cor i  constraint,  C  -  f?P  unit::,  on  the  entire  ..y..tern 
and  given  the  tabular  input;; 


choose  a  Run.  a  projectile,  and  a  fire  control  unit  so  that  the  quantity  A,  il/d'  i 
a  maxim. m.  At  this  point  the  serious  reader  is  encouraged  to  compute  the  f^(c) 
tables  directly  from  the  recurrence  relations  (l),  (?) ,  and  (jj)  using  the  given 
input  data. 

In  doing  so  he  will  observe  that  one  is  frequently  plagued  by  unnecessary 
computations.  That  is,  he  finds  that  integer  ’-nit  increases  in  the  value  cf  My 
argument  c  do  not  always  produce  increases  in  the  payoff  function  f^fc), 
inasmuch  as  the  increase  in  the  value  of  c  is  not  sufficiently  large  enough  to 
admit  the  consideration  of  an  additional  entity  (another  gun  or  projectile  cr 
fire  control  unit).  The  method  outlined  here  provides  a  remedy.  As  the  cost 
variable  is  allowed  to  increase,  only  those  values  cf  c  which  res-xlt  in  an 
increase  in  the  payoff  function  are  examined  by  employing  a  bookkeeping 
procedure  in  the  form  of  auxiliary  tables.  Using  Equation  (l),  we  shall  comp . ‘  . 
and  record  (in  the  table  below)  the  values  of  f^(z)  and  P(z)  associated  with  the 
cost  z.  . 


i  z^1^ 

f^zj1))  1  PC*^) 

1  1 

5  1 

2  2 

8  2 

5  h 

9  ? 

k  7 

11  U 

The  next  step  in  the  procedure  is  the  computation  of  f2(z).  Here  we 
encounter  the  difficulty  mentioned  above.  We  shall  resort  to  the  construct? cn  of 
several  auxiliary,  bookkeeping  Tables  11^  II2, . . . ,11.  Each  table  will  yirid 
at  most  one  row  entry  of  the  f^(z)  table. 


\ 


'i’ll.'  mt'ilntl  v'l’  coiwl  riM'i  i  <  >>  i  «»|*  I  lv  hnoVi-.i.-rpf  n/'  bullion  is  now  '  v  p  I-)  i  >  ,<  '1 . 
Table  J I j  !  r  nhi  h  I  i  cd , 


nr 


_(■’)  1 

x(.° 

1. 

a 

u 

:o 

i 

t 

*il)  -  i 

>0 

> 

V 

4°  - ! 

b'j 

> 

10 

.(1)  =  1 
"1 

6o 

u 

11 

(1' 

U  -  1 

■u5 

5 

—  r.  +  v(l)  .  ft  _  1  P  7  h  T 

where  c_  CG  G  '  u  ’  Jm 

Table  IIi+^  is  obtained  from  Tabic  11^  using  the  following  steps: 

1)  The  G  column  for  Table  II.  ,  is  the  same  as  the  G  column  for 

t+1 

Table  II.. 

i 

2)  The  entries  in  the  eolum  associated  wish  the  minimum  values 

J2)  .  °  (l) 

in  the  c„  column  of  Table  II.  arc  replaced  oy  z:  '  from  the  f  (z)  table.  If 

zf^  was  the  last  entry,  then  z|^|  io  replaced  by  a  large  number.  We  will  use 

the  symbol  «  to  emphasize  this  fact.  low  the  entries  cf  the  x/.1^  col  nn  of 

u 

Table  II.  .  are  the  same  as  the  adjusted  entries  of  the  column  of  Table  II,. 

l+x  U  i 

3)  The  entries  in  the  c„  column  of  II  -  equal  cl^  +  xi^,  where 

x+x  u  u 

G  =  1,  2,  5,  k,  5  and  x'^  is  an  entry  from  the  II  .  table. 

'j  1+X 

U)  Compute  g„(G)*f  (xj^). 

a  x  u 


The  resulting  tables  are 


r 


I 


We  will  now  obtain  the  entries  for  the  f2(z)  table  from  the  auxiliary  table:; 
in  the  following  manner: 

For  each  table  11^  let 


(2) 


min 

G 


&2,1- 


Then 


f2(x<2)) 


max  {g2(G)*f1(X^l))  /  c£2)  « 


zm. 

Z1  S* 


f2^Zi2^  *  {f2^Zi-l^  {g2(G)’fl(XG1^  /  CG^  =  Zi^f}’ 

G 


for  i  >  1. 


(2) 

From  our  example  we  obtain  z£  '  *  min  {4,  5,  7,  10,  ll}  =  U,  and 
f2(U)  =  max  {g2(l)*f1(l)}  =  max  {20}  =  20.  From  table  II2 

*2^  =  min  {5,  5,  T,  10,  11}  =  5,  and  f2(5)  =  max  {f2(4),  max  {g2(l)  *^(1) ,  g2(2)  ’^(l)}} 

=  max  {20,  max  {52,  50}}  =  52. 

If  we  continue  in  tliis  manner,  we  obtain  the  f2(z)  table: 


14 


i 

,(»> 

zi 

Gfzp5) 

x£1)(*|?>) 

1 

4 

20 

1 

1 

0 

i— 

5 

32 

1 

2 

3 

6 

48 

2 

2 

4 

8 

72 

3 

2 

5 

10 

81 

3 

4 

6 

11 

96 

4 

2 

7 

12 

138 

5 

2 

8 

14 

153 

5 

4 

9 

17 

187 

5 

7 

The  entries  in  the  G(z^2^)  and  columns  are  the  val'ies  of  G  and 

respectively,  which  yield  the  value  of  f2(zj2^).  If  f2^zi+l)  * 

(2)  (2) 

then  z'  (  and  the  values  associated  with  z'  i  are  not  recorded  in  the  table. 

i+1  ■‘■+J-  f. 

We  proceed  in  a  similar  manner  to  the  construction  of  the  f^(z)  table.  The 
auxiliary  tables  are 


III, 


J3) 

CF 

42) 

G5(F)-f2(X^2)) 

F 

.13) 

CF 

y  (2) 

jF 

G5(F)*f2(X^?)) 

F 

6 

4 

80 

1 

7 

5 

128 

1 

9 

4 

180 

2  , 

III2  =  9 

4 

180 

2 

14 

4 

320 

3 

14 

4 

320 

3 

21 

4 

500 

4 

21 

4 

500 

1 

J3) 

CF 

M) 

*F 

G5(F)-f2(X^2)) 

F 

J3) 

CF 

J2) 

*T 

G5(F)-f2(x£?)) 

F 

8 

6 

192 

1 

10 

8 

288 

1 

X<2>  0,(F)-f,,{X<",)|  F 


42)  G  (F).f2(X<2))|  F 


4^  x|2)  I  c,(F)-rr,(x^r  ))|  F 


12  10 


4^1  4g)l  °3(F)-fF(Xt?))l  F 


13  11 
13  8 


x£2)  G,(F)-f2(42))|  F 


1  o 

x(2) 

af 

G5(F)-f2(X^2)) 

F 

16 

1U 

6U6 

1 

15 

10 

729 

2 

15 

5 

512 

5 

21 

k 

500 

k 

X<2>  la  (F).f2(42))|  F 


42)  G  (F)-f2(42))|  F 


rc\ 

w.  to 

1  o 

42) 

G5(F).f2(X^2)) 

F 

19 

17 

lh8 

1 

17 

12 

122b 

2 

18 

8 

1152 

5 

21 

k 

500 

k 

=F3)  42>l  05(F)-f2(42))|  F 


V&*' 


Now,  tlic  fi(z)  tables,  1  =  1,  2,  3,  v i  1 1  yield  the  desired  results,  that  is, 
tlie  value  of  the  maximum  pay-off,  subject  to  the  constraint  on  the  total  cost, 
and  the  policy  used  to  obtain  this  maximum. 

The  entries  in  the  tables  are  interpreted  in  the  following  manner: 

In  the  f  (z)  table  the  column  labelled  f^(  )  contains  the  values  of  the 
j  o  ( v ) 

maximum  pay-off,  subject  to  the  total  cost  equaling  the  entries  in  z^  '  . 

In  the  column  labelled  F(  )  we  obtain  the  policy  F,  which  yields  this 

maximum;  and  the  value  in  the  column  labelled  x£,2^(z^^)  associated  with 

(1)  T  1 

z,  is  the  remaining  amount  to  be  used  for  determining  the  policy  G 


From  the  f2(z)  table,  select 


(which  will  be  obtained  from  the  f~(z)  table) 

(2)  d 

the  value  in  the  z^  '  column  which  is  equal  to  the  previously  determined 

entry  from  X^2^(z^^).  The  values  from  G(z^2^)  and  from  x!^(z^2^) 

T  1  (2)  1  G  1 

associated  with  this  entry  from  z^  are  the  policy  G  and  value  used  to 

determine  the  policy  P  from  f^(z)  table,  respectively. 

In  the  example  the  allowable  cost  is  22.  Hence,  from  the  f^(z)  table  we 
observe  that  the  maximum  pay-off  is  2176,  that  F  =  3#  and  that  the  amount  remain¬ 
ing  to  be  allocated  is  12  units.  Going  to  the  f2(z)  table,  we  determine  the 
policy  G  =  5  wiuh  a  remaining  cost  of  2,  which  yields  the  policy  P  =  2  from  the 
f^z)  table. 

Summarizing,  we  have  obtained  the  optimum  policy  P  =  2,  G  =  5  and  F  =  3> 
which  yields 

A  H.  4  -  8  -17- 16  =  2176 
v  S2 


with  a  cost  of 


Cp  +  CQ  +  Cp  =  2  ♦  10  +  10  =  22. 


In  the  general  problem  the  question  arises:  How  many  auxiliary  tables  does 
one  construct  at  each  stage?  We  can  compute  an  upper  bound  on  the  number  of 
tables  required.  Define 

ki  =  ®*n  *CiJ^'  1  =  1'  *•*  1  n  ; 

=  max  {c,  J,  i  =  1,  ...  ,  n  > 


J 

i 


Mi  =  min 


O  v  c  -W  •  » - 

j-i  j.i.i 


•  fmm - Tl'Wlf  HIMH—  I 


*■*"  *W  **  t—ji ^  *'**■?  ■*.,.*#,  < 


The  lust  augment,  Lit  the  f^zj1^)  table  ic  bounded  above  by  M.,  that 

is,  in  the  ith  stage  when  al.l  the  entries  in  thr  c_^  column  exceed  M.,  the 

EL  ‘ 

construction  of  the  auxiliary  tables  can  be  halted. 
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